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Introduction 

This final report summarizes several aspects of the research sponsored 
by the National Aeronautics and Space Administration under NASA Grant NSG - 
5Q13 for the period June 15, 1974 - August 14, 1975. The research dis- 
cussed in this report considers the "Encoding of Video Signals using Adaptive 
Delta Modulation", "Conversion of PCM to DM" and an Introduction to a 
new study area - "A Phase Locked Loop Using a Nonlinear Processor in 
lieu of a Loop Filter". 

An adaptive delta modulator has been constructed using the Song Delta 
Modulator and many results have been presented in prior reports (see the 
June 1975 - December 1975 Semiannual Report). Part I of this final report 

concludes our study of error correction of DM encoded signals corrupted by 

[ 

thermal noise. Future research in this area will focus on real time encoding 
of black-and-white and of color video signals. We are also beginning to look 
ati two-dimensional and frame-to-frame encoding. A real time DM has been 
constructed and the memory needed to permit frame-to-frame .encoding is 
being assembled. In addition, we are looking at source- encoding techniques 
with which to compress the DM encoded bit stream. This approach appears 
to be promising in as much as the DM bit stream provides sequences which 
are not equally likely. A discussion of this project will be made in our next 
report. A new area in which research is beginning is interference of RF 
signals containing DM encoded information. In this study we are looking at 
the effect of an interfering CW, FM, or other interfering signal with a PSK, 
DPSK, QPSK or FSK signal where the information being sent is a DM encoded 
bit stream. 

Part II of this report "Conversion from PCM to Adaptive DM" is a study 
of how to "fill in" extra samples of a PCM signal so that an adaptive DM bit 
stream can be obtained. In this report we derive an expression for the SNR 
of the DM signal derived by employing linear, 2-sample, interpolation between 
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sample points. We are currently investigating 3 - and higher sample inter- 
polation techniques. 

Part m is the introduction to a new study of PLL acquisition. Here we 
replace the linear loop filter by a nonlinear processor. Estimation Theory 
tells us that the optimum estimator in a PLL is a linear filter when the 
PLL is locked. However, when the loop is not locked the effective noise 
emanating from the phase detector is not gaussian. Thus, a nonlinear 
processor can provide more efficient acquisition. The purpose of a loop 
filter is to provide a voltage to the VCO so that it can correct its frequency 
and the nonlinear processor also provides this voltage. However, the algorithm 
employed by the nonlinear processor differs from the algorithm employed by 
the loop filter. As a matter of fact, we employ the SONG DM algorithm so 
that we tend to acquire exponentially. We intend to employ overshoot supp- 
ression algorithms to prevent overshoot once we have acquired. 

During the grant period several papers were presented at conferences 
and one is to be published. A complete list of publications and presenta- 
tions is given in Part IV. 

Participating in this project are : 

Drs. J. Garodnick and D. L. Schilling 

and Doctoral Students : 

R. Lei, J. LoCicero, V. Rao, N. Scheinberg, D. Ucci and 


L. Weiss. 



Part I Encoding of Video Signals Using Adaptive Delta Modulation 
Introduction 


A delta modulator algorithm is describled. The delta modulator 
algorithm is then, used to encode pictures and the encoded pictures are 
compared to the same pictures encoded by PCM. The effects of 
channel errors on the delta modulated video signal are explained and 
several error correction algorithms are explored. 

The Delta Modulator 

The delta modulator used to encode the pictures in this paper is 
shown in Fig. 1. The equations describing the operations of the delta 
modulator are given below : • • 

E k = Sgn ( Sfe - Xfc ) ( 1 ) 

x k + l =X k + \ + l < 2 > 


fUkl (E k + iE k -i),| A k U2a 

A 2AE k I l< 2A 


(3) 


Ejj = Output of the encoder 

Si, - input to the encoder - < , 

X k = The encoders estimate of the input signal at the K instant 
of time; also, the decoders output at the instant of time 


Ak 

A 


The step size of the delta modulator 

A constant that determines the minimum allowable value for 
*k 


There are other delta modulator algorithms besides the one described 


by Eq. 1, 2 and 3. In general the differences lie in Eq. 3, the way the 
step size is formed. In some delta modulators I A k j is a constant. In 
others it increases or decreases linearly. In our delta modulator the step 


size, 


A k » 


changes exponentially. It has been experimentally determined 


that an exponentially changing step size type of delta modulator is mere 
accurate then the other types of delta modulators at encoding a signal with 
large step type changes in amplitude found in video signals. Experimental 

work done by us, Cuttler Cl] and others, as well as theoretical studies 

2 

by Song [ 2 ] has shown that for video signals the step size should grow by 
a factor of about 1. 5 and decrease by a factor of . 5. The delta modulator 
described by Eq« 3 behaves this way* j 

j The delta modulator shown in Fig. 1' is not only a good encoder of 
video signals as compared with some other delta modulators, but it is also 
simple to impliment. From Fig. 1 we see that the decoder is the same as 
_ the feedback loop of the encoder. Delay elements and D 2 are each a 
single flip flop and the two multipliers are just sign gates ( exclusive or 
gates ). The multiplication by \ and the formation of the absolute value 
of is a wired operation and requires no additional hardware to impliment. 


The Step Response 

The response of the delta modulator to a step like input is shown in 
Fig. 2. The edges of objects in pictures are like steps; hence, examination 
of Fig. 2 will help explain what happens to edges in pictures that have been 
incoded by a delta modulator. Note from Fig. 2 that at first the delta modu- 
lator’s output does not rise as fast as the input signal. This effect is called 
slope overload. Slope overload on the edges of objects has the effect of 
delaying the appearance of the edge in the picture. After the delta modulator 
"catches up" with the input signal it often overshoots the input and then 
settles down to the repeditive four bit "steady state" pattern shown on the 
horizontal portion of the step. If the delta modulator is sampling the input 
signal at a rate greater than twice the nyquest rate, then all the frequency 
components in the overshoots and the steady state pattern will be higher 


than the highest frequency components in the input signal; hence they may be 
removed lay low pass filtering at the output of the receiver without .degrading 
the picture. 

The dotted line in Fig. 2 represents the response of the same delta modulator 
to the same step like input but the delta modulator had different initial conditions 
at the start of the step. These initial conditions resulted in a minimum of 

"slope overload" and would result in almost no delay in the appearance of 

| 

the edge in the picture. The effect of delaying an edge in the picture some- 
times, but not at other times, causes all sharp edges at right angles to the 
direction of scan to wiggle. This effect is called edge business. 

Edge business is the most serious hindrance to encoding high quality pictures 
at low bit rates with delta modulators. 


PCM vs Delta Modulated Pictures 

From Fig. 3 a comparision can be made between delta modulated pictures 
and 64 quantization level PCM encoded pictures. Note at high bit rates 
( 682 bits/line ) both PCM and delta modulation produce satisfactory pictures. 
At low bit rates ( 410 bits/hne ) edge business can be seen in the delta 
modulated pictures and a loss of resolution can be seen in the PCM encoded 
pictures. The edge business shows: up as a wiggliness along the right edge of 
my face, and the loss of resolution in the PCM encoded pictures is apparent 
by the loss of the stripes on my shirt. ’A subjective evaluation of Fig. 3 leads 
us to the conclusion that at high bit rates the PCM encoding is desirable 
and at. low bit rates delta modulation perserves more detail in the picture 
then PCM. ‘ V 
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The response of the delta modulator decoder to a step input at the 
encoder in the presence of a single channel error is shown in Fig. 4. 

The solid lines represent the output signal, Xfc, of the decoder in the 
absence of channel errors, while the dashed lines represent the output 
signal of the decoder in the presents of a single channel error. 

Channel errors have two effects on the delta modulator. The first and 
most obvious effect that can be seen in Fig. 4 is that channel errors always 
cause a permanent, and usually large DC shift in the received signal. 

Less obvious is the fact that a single channel error may cause an increase, 
decrease or have no effect at all on the step size of the delta modulator 
decoder [ % and less obvious still, is the fact that step size errors, 

when they occur, become self correcting within a few samples. Because 
step size errors last for only a few samples, and delta modulators 
typically sample at several times the nyquest rate of the input signal, 
the disturbance caused by step size errors is usually one to two pixels 
long and can bearly be perceived in the picture. 

We have both quantitative results and experimental evidence to support 
the statements made in the preceeding paragraph. The quantitative results 
were arrived at through the following process. Observe from Fig. 4 and 
Eqs. 1,2 and 3 that the step size, A^ , will decrease while the delta 
modulator is tracking a constant DC level. If the constant signal level 
persists long enough the delta modulator reaches the minimum step size, 

A, whether or not a channel error has occured. When the delta modulator 
reaches the minimum step size, the step size error has corrected itself, 
since both the corrupted signal and the ideal error free signal would 
have the same step size namely A,, the minimum step size. 
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The number of transmitted bits, ( e k ,s ), that will reach the receiver 
after the occurrence of a channel error, but before the step size corrects 
itself, has an upper bound for the delta modulator tracking a constant DC 
level. This upper bound can be shown to be 

• 75 “ /2 - V 4 k+ 1 

■ 2 In A / Av +1 ... 

or N = L — ( 4 \ 


N 5 the number of transmitted bits until step size correction occurs 

A k+ j 5 the step size one sample time after the occurence of the 
error 

A 5 the minimum allowable value for A k 

For the pictures in this paper the worst case parameters for Eq.4 are 
A = 1 and Afc+1 ** 16 which yield a worst case N = 19; If the delta modulator 
samples at six times the nyquest rate of the video signal then the step size 
error should last for less than 3 pixels if the conditions imposed in deriving 
Eq. 4 hold for a real picture. 

The series of pictures in Fig. 5 were taken to confirm the results of 
Eq. 4, ie, step size errors quickly correct themselves, and to comfirm. 
that channel errors cause a large permanent shift in the DC level of the 
output of the delta modulator. Fig. 5a shows the original picture without 
any errors. In Fig.Sb channel errors were introduced at a rate of one error 
for every 2,500 transmitted bits. From Fig. 5b we see that each c hann el 
error caused a shift in the level of the decoders output signal. This shift, 
seen as a streak, lasts until the end of the scanning line where the effect 
of the error is ended by resetting all the registers in the encoder and 
decoder to a fixed predetermined value* 


In Fig. 5c we have displayed the absolute value of the step size without 
any channel errors and in Fig. 5d we introduced channel errors. Fig. 5e 
is the difference between Fig. 5c and Fig# 5d. The uniform gray back- 
round in Fig. 5e represents zero difference between Fig. 5c and Fig. 5d 
or equivently, no step size error. The white and black dots are the 
regions where the difference between Fig. 5c and Fig. 5d was not zero or 
equivently, where a step size error exists. Fig. 5e confirms the fact that 
step size errors become self correcting after a few samples. The con- 
clusions that we have drawn from our studies of the effects of channel 
errors on delta modulated video signals is that channel errors have a 
significent effect only on the estimate, Xj c , of the delta modulator decoder 
and that error correcting schemes need only correct for errors in the 
decoder’s estimate, X^. 

Error Correcting Algorithms 

The preceeding analysis has revealed that channel errors effect delta 
modulated encoded video signals by changing the DC level of the decoded 
signal# In the rest of this paper we will describe three techniques to 
minimize this effect. 

Direct Approach 

. It is possible to correct the DC level of the decoders estimate by 
periodically sending the transmitters current estimate, Xj c , to the receiver 
The effect of this correction technique, (shown in Fig. 6) is to shorten the 
length of the error streaks. The more often the transmitters estimate is 
sent to the receiver the shorter the streaks become. Unfortunately the 


more often we send the transmitters estimate, the more we must increase 
the transmission rate bo accomodate this extra information. 

The equation that relates the several parameters that determine the 
increase in transmission rate is given by Eq. 5. 

f s ’ = f(|+-T) (5) 

where 

fg' = The bit rate with correction 
f - The bit rate without correction 

c = The number of times is sent to the receiver per frame 
b = The number of bits in each sent to the receiver 

fg 

s = The total number of Ej c transmitted per frame 

From Eq. 5 it is apparent that "c" and "b" should be as small as possible 
"c" is lower bounded by the desired degree of correction required in the 
picture since the length of the remaining error streaks the received 
picture are inversely proportional to c^and b is lower bounded by the 
accuracy of the correction. 

To understand the effect of b on the correction algorithm refer to 
Fig. 7. Fig. 7 shows how the correction algorithm is implimeated. 

First the "b" most siguificent bits of the transmitters estimate is sent 
to the receiver via a PCM format. Upon receiving the PCM word the 
receiver sets the "b” most significent bits in its estimate equal to the 
transmitters estimate. Then both the transmitter and receiver set their 
b-1 most significent bit to 1 and all less significent bits to zero. The 
total effect is to make the transmitter’s and receiver’s estimate equal, 
and to entroduce an inacuracy in the estimates equal to percent. 
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The effect of the inaccuracy in the estimates introduced by the correction 
algorithm is shown in Fig. 8. Note that the effect is transient and is completely 
undetectable for b = 4. The value b = 4 was used in the pictures of Fig. 6. 

Leaky Integrator 

The effects of channel errors on delta modulated encoded pictures can 
be minimized by introducing leaky integrators in the feed back loop of the 
encoder and in the decoder. Leaky integration is achieved by introducing 
the factor L, (L < 1), into Eq. 2 as shown in Eq. 6. 

X K+1 = LX K +A K+1 ( 6 ) 

If a channel error causes the estimate, X K ,to become shifted by an 
amount "e" at time "lc", then at time K + N Eq. 6 will become 

' Xk+N- L N X K 4SL N -* L N e (.7) 

From Eq„ 7 we see that the error "e" will leak away by the factor L, 
and after N samples the amplitude of the error will be L X e. Clearly, the 
smaller the value of L the sooner the error will disappear. The smallest 
value of L that may be used without degrading a picture with 64 quantization 
levels ranging from -32 to +31 is L =. 9S7. 

Fig. 9 shows the effect of using a leaky integrator with L = . 937 on 
delta modulated encoded pictures that were transmitted over a noisy 
channel. From Fig. 9 we see that the inclusion of leaky integration in our 
delta modulator will substantially reduce the effects of channel errors on 
the received pictures. 
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Line to Line Correlation 

In this section we will explain a technique, shown in Fig. 10, which 
locates error streaks in pictures and wliich then eliminates the streaks 
by readjusting the DC level of the streak to its proper value. 

To detect an error streak in a picture a comparision is made between 
the DC level of the portion of a scan line under test and the corresponding 
portion of the scan line above and below the line under test. If the DC level 
of the portion of the line under test differs from both the line above and 
below by more than a certain , 1 threshold' 1 then an error has been detected. 
When an error is detected the DC level of the portion of the line under 
test is replaced, by the average DC value of the corresponding portion of the 
line above and below. The part of the picture referred to as "the portion 
under test" is formed from "N" consective samples on a scaning line. 

If the first sample in the "N" samples is "i", then the algorithm indexes 
its "portion under test" by including the i+N+1 sample and dropping the 
i** 1 sample. 

There are two parameters in the above algorithm that must be adjusted, 
"N" and the "threshold", to eliminate the error streaks. In Fig. 11 we 
can see the effects of "N" and the "threshold" on both the error streaks 
and the quality of the picture. Small values of "N" and low thresholds 
eliminate the error streaks but they tend to degrade the picture by eliminating 
thin objects such as the bottom of my glasses as shown in Fig. lie. Large 
values of "N" and high thi'esholds leave some error streaks undetected 
and parts of others uncorrected but they do not degrade the picture. It 
is our opinion that Fig. 11c represents the best compromise between the 
degree of error correction necessary and the amount of degradation that 
can be tolerated in the picture. 



13 ) 


Conclusion 

Delta modulators can be used to encode video signals. The pictures that 
result from these signals are similar in quality to pictures that result from 
PCM encoders. The problem of channel errors causing "picture streaks" 
in delta modulated encoded video signals has been minimized by the algorithms 
presented in this paper. 
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DELTA MOD 682 BITS/ LINE 


DELTA MOD 512 BITS/ LINE 



DELTA MOD 410 BITS/ LINE 




PCM 512 BITS/LINE 



PCM 410 BITS/LINE 


Fig. 3 A comparison of an adaptive delta modulator and a PCM encoder of 
video signals; 170 scaning lines per picture; PCM pictures have 64 
quantization levels. 
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(e) 


Fig. 5 The effects of channel errors on delta modulated encoded pictures, 
(a) Delta modulated picture without channel errors; 682 bits/line, 
170 lines, (b) Error rate of 4 xlO' 4 . (c) Aboslute value of 
(d) Absolute value of with chanuel errors (e) Difference between 
(c) and (d), i.e. step size errors. 




rate; 1024 bits/line; 170 lines. 



(b) 4 corrections per line; 1.5% 
increase in bit rate. 



( c ) 8 corrections per line; 3% 
increase in bit rate. 


(d) 16 corrections per line; 
6% increase in bit rate. 


Fig. 6 The effect of sending the encoders estimate to the decoder to acheive 
error correction. 
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Fig. 7 Error correction is achieved by sending the "b" most 

significent bits of the transmitter's estimate to the receiver 
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(C) b = 3 


(d) b = 4 


Fig. 8 The effect of sending only the "b" most significent bits of the encoders 
estimate to the decoder for error correction. 
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Fig. 9 Error correction is acMeved by the use of a leaky integrator. 
( a ) Error rate 4 x 10* 3 ; 682 bits / line; 170 lines^ per picture 
( b ) Leaky integrator with a leak factor of 1 = .937 
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Part D. The D C Shift of Part C. is Subtracted from the 
Video Signal to Produce the Corrected Signal of 
Part D. 


] - . . ' ■ . ■ . 

_ Fig. 10 A line to line correlation algorithm for error correction 
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NOISY PICTURE 


ORIGINAL PICTURE 


THRESHOLD 1/32 P-P SIGNAL 
AVERAGED C ER 1/16 OF A LINE 


THRESHOLD 1/16 P-P SIGNAL 
AVERAGED OVER 1/16 OF A LINE 


THRESHOLD 1/32 P-P SIGNAL 
AVERAGED OVER 1/128 OF A LINE 


THRESHOLD 1/16 P-P SIGNAL 
AVERAGED OVER 1/128 OF A LINE 


Fig. 11 The results of using the line to line correlation algorithm on noisy 

pictures. 1000 bits / line; 170 lines per picture; error rate of 3 x 10 
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Part n 

Conversion From Pulse Code Modulation to Delta Modulation 


A. Introduction 


Frequently we encounter a situation where we have available a signal 

ejncoded in Pulse Code Modulation (PCM) format but we need the same 

sjignal in Delta Modulation (DM) form to be compatable with our overall 

Communication system. Since both encoding techniques are digital in 

nature we would like to construct a PCM to DM converter which can 

easily be built with digital hardware. In addition, we want to be able 
| • 
to analytically evaluate its perform by calculating the resulting Signal- 

to-Noise Ratio (SNR)* 

In order to understand the problem that exists in a PCM to DM 
converter we introduce an information source, x(t) , bandlimited to f . 


The PCM samples will then be available at the Nyquist rate, 

2f . 
m 

In general, our digital DM operates at a rate, f_, which is several 

s 

times greater than the Nyquist rate. In Fig. 1 we show a basic digital 

DM which 

is described by the following set of equations : „ 



e x (k) = sgn [ € (k) j 

(la) 

| 

$ x (k) = x(k) - x(k) 

(lb) 

and 

A A i; 

( 1c ) 

x(k) = x(k-l) + S k (k) 

where 

th 

S x (k) = step size at the k interval. 



Since we will primarily deal with conversion of voice signals, we 
shall specify the step size algorithm that is used with audio signals, 


S x (k) - J S x (k“l) | e x (k-l) + Se x (k-2) 


where 


s magnitude of the minimum step size. 
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Equation (2) is obtained from. the general Song DM Algorithm derived by 
minimizing a mean squared cost function. 

If we use the above step size algorithm along with Eq. (lc), we can 
construct a DM estimate tree. A DM estimate tree is a graph of all possible 
paths that x (lc) may follow starting with a set of initial conditions. The 
paths are generated from all possible ibinary sequences of e x (lt). In Fig. 2 
we show part of a DM estimate tree for the step size algorithm given in 
Eq. (2) on which we have superimposed two PCM samples, at points A and B. 

It is now easy to see where the difficulty lies in converting from PCM to DM. 

That is, in going from point A to points on the DM estimate tree adjacent to 
B, i.e. , points Bj, and B 2 , we can traverse any of four possible paths : 
lj, Lj, 1 3 or 1 4 . Which path to choose is exactly the problem that exists in 
PCM to DM conversion. 

B. Linear Estimation Technique . 

The most straight forward approach to solve the multipath problem, is ; 
to estimate the information signal between PCM samples and use these signal 
estimates as the input to an adaptive DM. We will then automatically generate 
a DM encoded signal, e x (k), and at the same time choose a path thru the DM 
estimate tree. If the Nyquist sampling period is T = 1/2 f and the DM sampling 
period is r = l/f £J then we shall require that T be an integer multiple of r 
and therefore we must specify II PCM signal estimates every Nyquist period, 
where 

R = T/r. (3) 


*C. L. Song, G. Garodnick and D. L. Schilling, " A Variable Step Size 
Robust Delta Modulator ", IEEE Trans. Commun. Tech., vol. COM- 19, 
pp. 1033-1044, Dec. 1971. 


A linear estimation technique that will accomplish this and can easily be 
implimented with digital hardware is shown in Fig. 3. Here we form a 
Differential PCM (DPCM) signal, 

y(Ek) = x(Bk)-x(R(k-l)), (4) 

which is then digitally scaled by a factor l/R, sampled and accumulated 
at the DM rate, f s . The resulting signal, v(k), is then DM encoded and 
our conversion is complete. If we assume that the DM is operating fast 
enough such that there is minimum degradation between the DM estimate 

*•* . ■ • : r. .**. i 

and its input, v(k), then we can approximate the estimate, denoted by w(t), 
as a piecewise linear curve obtained by connecting the PCM points. This 
will be the basis of our performance analysis and the calculation of in- 
band SNR. 

C. Optimization of Converter Performance 

The figure of merit for our converter will be the output in-band SNR. 
However, if we use the difference between x(t) and w(t) as the source of 
the output noise this will yield misleading results. Without loss of 
generality, we can amplify and delay w(t) to improve SNR. This is 
bhcause attenuation and phase shift cause no distortion in audio signals. 

j 

in general, if w(t) were really obtained from a linear transformation of 
the PCM samples, then we could conceivably use a linear filter to 
perform the inverse transformation and have no signal degradation at all. 
However, since w(t) is really obtained via a non-linear transformation, i.e. 
thru the DM, the inverse transformation filter may not be physically 
realizable. 

If we allow w(t) to be scaled by a factor, K, and delayed by a time,y, 


then the error signal that we are concerned with becomes 


d(t) = x(t) - K w(t -y), ( 5 ) 

We can now determine the autocorrelation function of the error signal as 

BatT) - E[d(t)d(t + T)l (6) 

W = ^>K 2 B w (r)-Kti^ w (T-y)+R xw (T+y)]. (7) 

where ' ; 

I ^(t) = the autocorrelation function of x(t), 

R (t) * the autocorrelation function of w(t) 
and 

R xvv (r) = the crosscorrelation function of x(t) and w(t)„ 

Taking tlie Fourier transform of Eq. (6), we obtain the power spectral 
density of the error signal, 

Ga(f) = cyi) + K 2 <yq - 2Koos(2«y ) c^f). (8) 


Finally, integrating over the input signal frequency band, we can find 
the in-band noise power, P<j, and the in-band signal power, P s , where 

p^m i 

Pd e J G d(f)df . (9) 

:■ - f m v . ■: 


P d = P x +K%-2K 


f : 

£”cos(2irfy) (10) 


and 


Ps - Pw ; 


Using Eqs,(10) and (11), we can form our figure of merit as 
Q s SNR s:p g /]^ 
which is found to be 
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P x + k2p - 2K|j(y) 


(13) 


P m 

U(y) ■ J COS ( 2irfy) Gj^fJdf . 


(14) 


Now we seek to maximize Q by applying 

* 2 Q(K, y) Bfl< 
aysK 


(15) 


K we set BQ/Sy equal to zero, we find that y is a constant, denoted as y Q , 
independent of K, and satisfying the relationship 


f sin ( 2vrfy 0 ) G^fjdf = 0. 


(16) 


The result of equating SQ( K, y )/ SK to zero gives us the optimum K as 

K 0 = p x /n(y 0 ). (i 

Finally we have the maximum SNR, Q 0 = Q (K Q , y Q ), expressable as 

q„ ^ — -• 

iW - h (yo ) 


where 


p*m 

<%) * J cos (2fffy p ) G^(f) df . 


D. Evaluation of Converter SNR 

In order to determine the SNR of our converter, we must first calculate 
the autocorrelation function of w(t) and the crosscorrelation function of x(t) 
and w(t). To accomplish this we set up a coordinate system depicted in 



Fig. 4 and observe that the piecewise linear curve, w(t), is actually the 
sum of a sequence of ramps of slope m. and steps of amplitude w.. To 
insjure statioaarity in the random process, w(t), we introduce a random 
starting time for the ramp functions shown as -t q » We also introduce the 
random variable. A, which is uniformly distributed in the interval 0 to T. 

To completely define our system, we specify the parameters 

j = [ t/T 3 = the greatest integer < t/T, 

T ■ 5T + %, 

and ' • : ■ ' ■ ■ * . / 

17 = r - jT + A, for O^A :£ T» 

We will first determine the autocorrelation function of w (t) . In order to 
facilitate matters let us express the ramps at times t^ and tg as 

( 19 ) 

and 

z{t 2 = t l + T) = ,?7<T 

m j+ 1 (77-T), n> T. ( 20 ) 

Now we can find the autocorrelation function of the ramps, i. e. , 

EC - (l/2T)VT-» 0 ) 2B m<j) + (VST) (T-iy 3 !!^)) 

+ (1/2T) (t) 0 -T)[T 2 -(T-n 0 ) 2 J 1^0) 

+ (l/3T)[T 3 -(T^ 3 ]H m (J+l), (21) 

where ' 

VO) - E(m 0 m^) = [ 2iyi) - R x 0+1) - \0-l) ] /T 2 ( 22) 

and. 

■ * ^a*). " 


If we combine the ramps and the steps, then we. can represent w(t) at times 
and tg in the following way : 

= w G + m 0 X (23) 

and V: S'"' ' . 

w(tj) = w.+m.T) s 

w j+1 +m j+1 (»7-T), V>T • (24) • 

Using the result found in Eq. (21), we proceed to evalutate the autocorrelation 
function of w(t), that is, 

E [w(t,)w(tj) ] = (l/TMT-D^Vi) + (X/T) (T-»J 0 ) 2 (2T+?) o )R m (]) 

+ (l/aTKT-lJ^E^Wj) + (l/2T)(T 2 -r) 0 2 )E(mj'V 0 ) 

+ W 0 /T) V i+1 > + Wo 2 / 6T >( 3T ''V K m (j+1 > 

+ Wo / 2T )( 2T -1 0 ) E ( m o w j+l) + Wo/2T) E(m j+1 w 0 ), (25) 

where 

RwO) * E(w Q Wj) = R x (j) (26) 

and 

E (mjWj,) is a function of R^j). 

Simplifying Eq. (25) we arrive at the final form of the autocorrelation 
function of w(t) 

R W (T) * W/BT 3 ) [ SR^j) + RxO+2) ] 

+ [(T-T) o ) 3 /6T3][R x (j-l) + 31^0+1) ] 

- (1/T 2 ) * 

+ (2/3) [ I^CJ) (27) 

where 

0 S i) < T 
o 

and recall that 

j = C t/T ] = the integer < t/T > 
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Employing the notation for w(tj) introduced in Eq. (23), it becomes 
quite a less formidable task to calculate the cross correlation function 
between x(t) andw(t). This can be expressed as 

^(r) = i i^ir) - eCw^x^ + t)] 

■ ■' . .v-i.;-.-'. 

= (1-X/T) P x (r+X) + (X/T) P^t-J-X-T) , (28) 

! , • / 
i ■ ■ 

j 

where tlie average in Eq. (28) is over the random variable X. This 
result can be further reduced to * 

' : i " ■ 

'■ T 

* flbnyCf) = (l/T)J o (l-X/T)[R x (r+X)+R x (T»X)]dX. (29) 

At this point we see that if the correlation function of x(t) is specified, 

then we can formulate the correlation function of d(t) as given in Eq„ (7) 

and its power spectral density from Eq. (8). Furthermore, we can 

continue to simplify our results and show that the power spectral density 

obtained from R (t) is a function of the power spectral density of x(t). 
xw 

Taking the Fourier transform of Eq. (29), we obtain, in its simplest form, 
G^ v (f) = [2(l-cos(2!rfT))/(2fffT) 2 ]G x (f), (30) 

We are currently in tlie process of determining numerical results for 
input signals having various spectral shapes. Among those being investi- 
gated are signals with flat and triangular power spectral densities up to f m . 
In order to obtain these numerical results we must determine not only the 
various power spectral denilles and in-band powers discussed above, but 
we must also solve the optimization relationship given in Eq. (16) « Then 
we can evaluate the maximum SNR, Q q , as given by Eq. (18). 
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Part HI A PLL Using a Nonlinear Processor Instead of a Loop Filter 
I. Introduction 

The Phase Locked Loop (PLL) is a device which has wide application in the 
field of communications. It can be used for carrier tracking, FM demodulation, 
and bit synchonization. An analog PLL is shown in Fig. 1 and consists of a 
Phase Detector (PD) or Comparator (PC), a linear filter and a Voltage Controlled 
Oscillator (VCO). The incoming signal is of the form. 

f(t) = -2 cos [2 n f c t + 0,n(t)] + n^t) 

and the VCO waveform is ' 

v(t) = sin [2rfct + 0 v (t)] ’ 

•where f c is the nominal input carrier frequency, f Q is the VCO carrier frequency, n^t) is 
white Gaussian noise, 0 m and 0 V are the phase of the input and VCO waveform 
respectively. In FM demodulation f Q is usually close to f c and 0^(t) is then an 
approximation of ^(t) the information signal. In carrier tracking or bit 
synchonization L, is not in general equal to f . Instead during the transient 
there is a difference between the two, A f = f* - £j , and the loop attempts to 
r minimize tliis difference. When Af is "small" the loop is said to be in lock. 

The time required to do this is the acquisition time . Obviously the shorter this 
time the better. 

Most PLL’s whether analog, hybrid or digital in nature use linear filters 
in the loop as the processor. The PD extracts the sine of the difference between 
the arguments of the input and VCO waveform. Tins signal is then filtered and 
used to drive the VCO in such a way as to reduce the phase error between the 
input signal and VCO waveform. 

In the system we are considering however the filter is not linear. Instead 
the filter we use consists of a hard limiter and processor (Fig. 2) which steps 
the VCO in discrete steps towards nulling the phase error <Pq= 0 m - 0 V , 
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This affords iis greater control over the VCO and lends itself to a discrete 
analysis of the systems. 

Two systems we will consider use a linear processor and an adaptive processor; 
The two processors will resemble Delta Modulators (DM) in that the algorithm 
which produces the input to the VCO is based on the algorithms of DM's we 
have been investigating. The adaptive algorithm has been found to be useful 
In video application since it has a rapid rise time. This will allo w faster 
acquisition in carrier tracking problems. 

Let us now examine the system we have proposed. 

II. The Basic Systems ’ 

. In Fig. 2 if we replace the adaptive processor by a unity gain we have a 
linear processor. 

Consider the system shown in Fig. 3. 
where s(t) = sin[w c (t) + 0 m (t) ] + n w (t) ( la) 

f(t) = sin 0 g (t) + ^(t) , (lb) 

0e(t) =0 m (t) - 0^(t) (lc) 

and n^t) is zero mean white Gaussian noise [ 1] of power spectral density 
n 0 /2. f(t) is the input to an integrate and dump filter which produces an output 
(v 0 (t) ) voltage every T seconds where 

v c (t) « y(t) + n f (t). (2) 

y(t) is the output of the integrate and dump filter due to the deterministic 
signal and n^(t) is the component due to the noise, i.e. 


if 

(3a) 

y(t) = Y o sia 0e( x ) dX 

1 rT 

n|(t) » — FjrJ o Uj(X)d\. 

(3b) 


let us now examine the noise term n£(t). Since n^t) is zero mean white 
Gaussian noise n*(t) is represented by a Wiener Levy process [ 2 ]. 
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and 


nf(t) = 0 
Varnf(t) = '= tr 


“o =,2 


(4a) 

(4b) 


We therefore have that the probability density function (pdf) of the noise 
component is 

1 -0/2j2 (5a) 






where o & is given above. 

From Fig. 1, one can see that 

*«> . = 


V G (t) 


*-*vco 


sgn v 0 (t) 


(6a) 


or 


0 e (t) = 0m(t) - Gvco S S Q v 0 (t) (6b) 

' ; i i * 

» 

Let us approximate the differential 0 e by a difference as follows: 

■ M • ktw] - #eD ‘T}J7 t (V) 

so we have ■ ’ 

0e [(k+l)T] - 0 e [kT] = 0m(kT) - G 0 sgn[~J o sin0 a (\)d\. + n f (lc)J (8) 


where G 0 = Gy CO r and kT ^ X <(k+l)T 

We now consider the above problem for one case of input information 

signal, 0 m (t). -faf.-: 

A. Phase Offset 

1. linear mode • 

• * , 

Let 0jn(t) be a constant 0^ so that 0 m (t) = 0 assume initially that 
0y(O) -0 O so that <fe(0) =0 m (O) - 0 V (Q) « 0£ - 0 O = A0. The difference equation 


governing the above is then 

0 e (k+i) - 0 e (k) = -G 0 sgn JV 0 (k)j (9) 

where we have normalized T to unity for simplicity. 

From the above equation we notice the phase error, ^(k) will change from 
its previous value 0 e (k-l) by ± G 0 depending upon the sign of v 0 (k-l) * If we start 
with 0 v (o) t=0^j and progress through the various states 0 y (k) can attain we find 
that a tree structure as indicated in Fig. 4 will be developed. 

Since in a PLL, one wishes to drive the (steady stats) error to zero, i. e. 
acquire lock we would like to know how long it would take to reach steady 
state* Let us now define what we mean by steady state. It is kno wn that 
many DM’s when responding to a step use will attain a repetitive pattern 
after some inital transient. 

For a linear DM, which is the type illustrated in Fig. 1, the periodic 
pattern is a square wave as indicated inFig. 5. For another type of, DM i. e. 
an adaptive DM, the pattern may appear as in Fig. 6, ilk trated for the 
Song Video Mode DM ( by inserting the proper processor after the sgn 
function in Fig. 2. this type pattern will emerge). As one can see from 
Fig. 4 there are many ways to approach steady state. We are interested in 
finding the longest or worst time case in which we are assured to within a 
A ( delta ) region of acquiring steady state lock ( i.e. a confidence interval ). 

To do this we will proceed as follows : we will find the transition probabilities 
between adjacent states; then find the path probabilities for each path that 
reaches a state which is representative of acquisition ( e.g. in Fig. 4 states 
(28,46,...); (36,56,...)),. We will then sum the probabilities of the most 
likely paths until this sum is within our confidence interval. The longest for 
this to happen i. e. the worst case will be our acquisition time. We may then say 
for example that we are 95% sure that in 50 sampling instants we will reach 
steady state. ' 


42 ) 


In reference to the condition of a phase offset let 
z(lt) = y(k) + n f (k) 


XT 

Since y(k) = ~ / sin 0 e (X )dX it is a random variable at time k because 


0 e (X) is a random variable. Therefore 


and 


Pz(r/y = -s)“P„.(v-Y/y = y) = (== 
1 V2V 


) © 


•(y-y) 2 /^ 


F 3 (y /y = Y) = Prob(y < r/y = Y) 


(10a) 


(10b) 


where a* is given above ( Eq. (4b) )„ Now, let us define x(k) as follows : . 


so that 


and 


x(k) i G 0 sgn [z(k)] 

P x (k)(“ = +G 0 ) = P Z (lc)(y^°) = 1 - F z (k)(o) 
P x (k)< a = " G o) = Pz(k)(y<») " F z (k)(o) 

P 0 ( 0 e( ]c+1 ) / 0 e ( k » = Px(" + 0 e ( lt )) 


( 11 ) 

(12a) 


( 13 ) 


The procedure for finding the time to acquire is now clear. We use 
Eq. (13) in conjunction with Eqs. (12) and (10) to find the transition 
probabilities. 

Since each transition is independent of the previous one ( the process is 
a Markov - one process ) the path probabilities are the product of the 
transition probabilities of each state pair in a given path. These path 
probabilities are summed until the total is greater than or equal to the 
confidence interval desired. We are presently involved in developing an 
algorithm which will simplify the computation of path probabilities and then 
allow us to evaluate the performance of the system and determine the 
optimum parameters. : v y ' ••• 
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2. Adaptive Mode 

In the adaptive mode we make the following modification. The adaptive 
processor now takes oh the form indicated by the equations below: 

0e( k+1 ) = + A0 e (k) (14a) 

A0 e (k) = I A 0 e G^-l) I ( b(k-l) + i b (k-2) ) (14b) 

These equations lead to an exponentially rising estimate which can be 
analyzed as before. The states are now no longer separated by a uniform 
amount but by a varying level (Fig. 7). A characteristic of this system is 
to have large overshoots, but an overshoot suppression algorithm which has 
been developed [ 3 *j for this mode of operation can be used to reduce the 
overshoot. This enables the system to reach steady state more rapidly and * 

this will reduce acquisition time. ! 

' ' { 

Presently computer simulation of this system are being investigated in j 

reference to acquisition time. . I 

‘ ^ -.v , / j 

- ! 

' | 

. . . ■•••••. 1 
’ . ■ ^ . : I 

. ■ . s 

* • I 

i 


s 

I 


References 


( 1 ) Viterbi, A. J. Principles of Coherent Communication, McGraw Hill, 
New York, 1956. 

(2) Papoulis, A. Probability, Random Variable and Stochastic Processes, 
McCmw Hill, New York, 1935, pp. 436-437. 

(3) Weiss, L. et.al. "Overshoot Suppression in Adaptive Delta Modulator 

Ionics for Video Transmission", National Telecommunications 
Conference, Atlanta* Georgia, Nov. 26-28, 1973. • 




r u 



Figure ?• A General Ada ptiv e 



Adaptive 

Processor 



P L L 










Figure 5. Linear DM Steady State Pattern Figure 6. Adaptive DM Steady State Pattern 




51 ) 


Part IV Publications and Presentations 

1) M. Z. Ali, L Paz, N„ R. Scheinberg and D. L, Schilling, 

^'A Technique for Correcting Transmission Errors in Delta 
Modulation Channels", 1974 International Conf. on Commun. 
Record, pp. 44F-1 - 44P - 6, 

2) J. L. LoCicero, D, L, Schilling and J. Garodniclc, "Direct 
Arithmetic Processing of Delta Modulation Encoded Signals", 
1974 National Telecommun. Conf, Record, pp, 392-397. 

3) N. R. Scheinberg, D, L, Schilling, M. Z. Ali and I. Paz, 

"A Teclinique for Correcting Transmission Errors in Video 
Delta Modulation Channels", 1975 International Conf. on 
Commun. Record, pp. 27-21-27-25. 

4) L. Weiss, I. Paz and D. L. Schilling, "Video Encoding Using 
An Adaptive Delta Modulator With Overshoot Suppression", 
IEEE Trans, on Commun. , Vol. COM-23, Sept. 1975, 

pp. 905-920, • . 



